干眼症（DED）的患病率为5％至50％，是眼科医生咨询的主要原因之一。 DED的诊断和定量通常依赖于通过缝隙灯 - 检查的眼表面分析。但是，评估是主观的且不可再生的。为了改善诊断，我们建议1）使用考试期间获得的视频记录在3D中跟踪眼表面，以及2）使用注册框架对严重程度进行评分。我们的注册方法使用无监督的图像到深度学习。这些方法从灯光和阴影中学习深度，并根据深度图估算姿势。但是，DED考试经历尚未解决的挑战，包括移动的光源，透明的眼组织等。为了克服这些挑战，我们为这些挑战并估算了自我动机，我们实施了联合CNN体系结构，具有多种损失，包括先前的已知信息，即通过眼睛的形状，即通过语义分割以及球体拟合。所达到的跟踪误差优于最先进的，其平均欧几里得距离低至我们的测试集中图像宽度的0.48％。该注册将DED严重性分类提高了0.20 AUC差异。拟议的方法是第一个通过单眼视频监督来解决DED诊断的方法
translated by 谷歌翻译
We propose KnowGL, a tool that allows converting text into structured relational data represented as a set of ABox assertions compliant with the TBox of a given Knowledge Graph (KG), such as Wikidata. We address this problem as a sequence generation task by leveraging pre-trained sequence-to-sequence language models, e.g. BART. Given a sentence, we fine-tune such models to detect pairs of entity mentions and jointly generate a set of facts consisting of the full set of semantic annotations for a KG, such as entity labels, entity types, and their relationships. To showcase the capabilities of our tool, we build a web application consisting of a set of UI widgets that help users to navigate through the semantic data extracted from a given input text. We make the KnowGL model available at https://huggingface.co/ibm/knowgl-large.
translated by 谷歌翻译